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The University of Arkansas 
was founded in 187] as the flagship 
institution of higher education for the 


state of Arkansas. Established as a 


land grant university, its mandate was 


threefold: to teach students, conduct research, and perform service and outreach. 


The College of Education and Health Professions established the Department of 
Education Reform in 2005. The department's mission is to advance education and 
economic development by focusing on the improvement of academic achievement in 
elementary and secondary schools. It conducts research and demonstration projects 
in five primary areas of reform: teacher quality, leadership, policy, accountability, and 


school choice. 


The School Choice Demonstration Project (SCDP), based within the Department of 
Education Reform, is an education research center devoted to the non-partisan study 
of the effects of school choice policy and is staffed by leading school choice researchers 
and scholars. Led by Dr. Patrick J. Wolf, Distinguished Professor of Education Reform 
and Endowed 21st Century Chair in School Choice, SCDP’s national team of researchers, 
institutional research partners and staff are devoted to the rigorous evaluation of school 
choice programs and other school improvement efforts across the country. The SCDP 
is committed to raising and advancing the public’s understanding of the strengths 

and limitations of school choice policies and programs by conducting comprehensive 
research on what happens to students, families, schools and communities when more 


parents are allowed to choose their child’s school. 


Bigger Bang, Fewer Bucks? 


The Productivity of Public Charter Schools in Eight U.S. Cities 


Executive Summary 


In 2013-14, the United States spent over $630 billion’ on its public education system in hopes of 


providing children with greater opportunities to excel academically and improve their life trajectories. 


While public education dollars have risen at a relatively fast pace historically, education policymakers 


and practitioners should be seeking to economize, given the uncertainties of future funding levels 


and underfunded pension liabilities.2 Meanwhile, the number of public charter schools has increased 


exponentially. From 1991 to 2014, charter school legislation passed in 42 states and the nation’s capital, 


and student enrollment increased to around 2.7 million.? 


Since educational resources are limited, it is 
imperative that we examine which types of 
schooling offer society the biggest “bang for 
the buck.” Both cost-effectiveness and return- 
on-investment (ROI) analyses compare the 
productivity of different organizations that are 
providing a similar service - in this case, public 
education. Cost-effectiveness is “the efficacy 
of a program in achieving given intervention 
outcomes in relation to the program costs.” 


Return-on-investment (ROI) is: 


A performance measure used to evaluate the 
efficiency of an investment or to compare 

the efficiency of a number of different 
investments. ROI measures the amount 

of return on an investment relative to the 
investment’s cost. To calculate ROI, the 
benefit (or return) of an investment is 
divided by the cost of the investment, and the 
result is expressed as a percentage or a ratio.° 


In this report, we examine the differences in cost- 
effectiveness and ROI! for public charter schools 
and traditional public schools (TPS) in eight major 


cities in the United States. The cities are Atlanta, 


Boston, Denver, Houston, Indianapolis, New York 
City, San Antonio, and the District of Columbia. 
We utilize data on how much money is invested 

in public charter schools and TPS, what levels of 
student achievement are attained across the two 
public school sectors, and how much economic 
payoff our society can expect to receive as a result 
of the educational investments in each sector. 
Ours is the first study to examine these differences 


across the United States at the city level. 


We calculate the cost-effectiveness of the charter 
and TPS sectors in each city by taking the average 
National Assessment of Educational Progress 
(NAEP) scores achieved by each of them and 
dividing by their respective per-pupil revenue 
amount. Our cost-effectiveness measure is the 
amount of NAEP math and reading points 
generated from each $1,000 in per-pupil revenue 


committed to each sector. 


Our determination of the return-on-investment 
(ROI) in the public charter and TPS sectors 
requires additional data. We use information 
about the expected economic benefits accrued 
from spending 13 years (K-12) in each of the 


sectors to make that calculation. We also provide 


a hybrid ROI estimate based on a student 
spending 6.5 years in the charter sector and 6.5 
years in the TPS sector. Since higher student 
achievement is associated with higher lifetime 
earnings, we are able to divide the cognitive 
impact of the K-12 educational experience by the 
cost-of-investment for each sector to calculate 
city-level ROIs. Finally, we provide cross-city and 
student-weighted averages for public charter 
and TPS cost-effectiveness and ROI based on 


our sample. 


Overall, we find that public charter schools 
outperform TPS on both productivity metrics 
overall and for all eight cities. In particular, our 
cost-effectiveness analysis finds: 

e Inall eight cities, public charter schools 


outperform TPS in both math and reading 
cost-effectiveness; 


e The public charter school sector delivers 
a cross-city average of an additional 4.34 


NAEP points per $1,000 funded in reading, 
representing a productivity advantage of 
32 percent for charters, while the student- 
weighted public charter school advantage 
of 3.99 points per $1,000 represents a cost- 
effectiveness benefit of 35 percent; 


The public charter school sector delivers 

a cross-city average of an additional 4.73 
NAEP points per $1,000 funded in math, 
representing a productivity advantage of 
33 percent for charters, while the student- 
weighted public charter school advantage 
of 4.37 points per $1,000 represents a cost- 
effectiveness benefit of 36 percent; 


The cost-effectiveness advantage for charters 
compared to TPS regarding NAEP reading 
scores ranges across the cities from 2 percent 
(Houston) to 67 percent (Washington, D.C.); 


The cost-effectiveness for charters compared 
to TPS in terms of NAEP math scores ranges 
from 2 percent (Houston) to 68 percent 
(Washington, D.C.). 


Figure ES 1: NAEP Points per $1,000 of Funding in Public Charter Schools versus TPS, Cross-City Average 
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Note: Revenue data pertain to the 2014 Fiscal Year, which aligns with the 2013-2014 Academic Year, and are adapted from Charter 
School Funding: Inequity in the City, by Wolf et al., 2017, http:/www.uaedreform.org/charter-school-funding-inequity-in-the-city/. 


NAEP achievement data are from 2015 and are adapted from http://nces.ed.gov/nationsreportcard/naepdata/dataset.aspx. 
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Our return-on-investment (ROI) analysis finds: Figure ES 2: Additional Percentage ROI for Public Charter Schools 


: a : Relative to TPS 
e Inall eight cities, public charter schools 


outperform TPS in standardized test 
scores despite receiving less funding per 


pupil; 


e On average, each dollar invested ina 
child’s K-12 schooling results in $4.67 
in lifetime earnings in TPS and $6.44 
in lifetime earnings in public charter 
schools, demonstrating a 38 percent 
public charter school advantage, while 
the student-weighted average charter 
school advantage in ROI is $2.09 or 53 
percent; 
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e Spending only half of the K-12 


educational experience in public charter 6.5 Years 13 Years 
schools results in $5.40 in benefits YEARS OF CHARTER SCHOOLING 
for each invested dollar, a 16 percent 

advantage relative to a full-time (13 year) Note: Revenue data pertain to the 2014 Fiscal Year, which 


aligns with the 2013-2014 Academic Year, and are adapted 
from Charter School Funding: Inequity in the City, by Wolf et 
student-weighted; al., 2017, http:/Awww.uaedreform.org/charter-school-funding- 
inequity-in-the-city/, Achievement data are standardized 
relative to the state overall and cover 2006-07 to 2011-12 


K-12 experience in TPS or 29 percent if 


e The ROI advantage for an entire K-12 


education in public charters compared and are taken from the Center for Research on Education 
to TPS ranges from 4 percent (Houston) Outcomes (CREDO) Urban Charter School Study: Report on 41 
to 85 percent (Washington, D.C.). Regions, http://urbancharters.stanford.edu/summary.php. 
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Bigger Bang, Fewer Bucks? 


The Productivity of Public Charter Schools in Eight U.S. Cities 


Introduction 


President Donald Trump called for a $20 billion® 
reallocation of federal funds towards school 
choice programs during his campaign and 
appointed a strong supporter of school choice, 
Betsy DeVos, as U.S. Secretary of Education. These 
two events in particular have led to a robust 
discussion concerning the potential merits - and 


possible downsides - of choice programs. 


School choice skeptics frequently claim that 
public charter schools perform no better than 
traditional public schools (TPS) on 
standardized test scores.’ Although a 

few individual studies of public charter 
schools have supported that claim,’ the 

most comprehensive research reports 
conclude that, though results vary across 
states and charter school networks, on 
average public charter schools have a 
positive effect on student achievement? 
Charter school performance appears to be 
especially strong in cities.!° Moreover, none of 
the studies of the relative effectiveness of public 
charter schools have explicitly considered the 
funding differences that exist across the two 
public school sectors. All of our research team’s 
prior reports have found that students in public 
charter schools receive substantially fewer annual 
educational resources than their TPS peers." 
Private philanthropy does not compensate 
charters for the lack of equity in public funding 
because TPS receive it, too, and philanthropic 
dollars compose only 2.5 percent of total charter 


revenues nationally.” 


Our team has produced the only prior study of the 
productivity of public charter schools, accounting 
for both their effectiveness and funding relative 

to TPS.'? Across our sample of 21 states plus the 
District of Columbia, we found that public charter 
schools generated 17 additional NAEP points 

in math and 16 additional points in reading per 
$1,000 funded compared to TPS. We reported 
that the return-on-investment from a child 


spending half of their K-12 experience (6.5 years) 


All of our research team’s prior reports 
have found that students in public 
charter schools receive substantially 
fewer annual educational resources 
than their TPS peers. 


in a public charter school was 19 percent higher 
than from a child being educated exclusively 
in TPS. 


Our previous public charter school productivity 
study compared charters to TPS at the state 
level. Most public charter schools open in cities, 
specifically to serve highly disadvantaged 
students. Do public charter schools demonstrate 
a productivity advantage in various cities across 


the U.S.? In this study, we aim to find out. 


In our most recent school revenue study, our 
research team found that funding inequity has 


continued through the 2013-14 school year in 
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Do public charter schools demonstrate a productivity advantage in 
various cities across the U.S.? In this study, we aim to find out. 


12 out of 14 metropolitan areas examined in using revenue data from the fiscal 2014 school 
the U.S. Across the 14 locations, public charter year. Cost-effectiveness is measured by how 
schools received $5,721 less per pupil than TPS, much 2015" National Assessment of Educational 


representing a funding inequity gap of 29 percent, Progress (NAEP) math and reading test score 
on average. points each sector produced for each $1,000 
spent per student. Our second measure - RO! - 


In spite of the economic recovery, state and 


? converts the learning gains experienced by public 
local governments remain concerned about gg E ye 


their ability to finance public education. It is retest clue 1 Sxolle | tal ase tcinler se Letecielrelnilie 


vital to determine where scarce 


educational resources should be Funding inequity has continued through 
allocated to maximize student the 2013-14 school year in 12 out of 14 
avecess Qubeuttenestady'builds metropolitan areas examined in the US. 


upon our most recent charter 


funding inequity report by focusing 


on how taxpayer investments translate to student simone slamesistvreteh lo ei yearse inl oe\e ein 


pliteormesae cee thee ore linliceencelevaceans lifetime earnings, and compares those benefits to 


WE aie aes to commen functas aasad aak the total revenues invested in each student's K-12 


outcomes for a subset of eight of the 14 locations education. 


We are able to connect funding to student outcomes for a 
subset of eight of the 14 locations previously examined - Atlanta, 
Boston, Denver, Houston, Indianapolis, New York City, San 
Antonio, and Washington, D.C. 


previously examined - Atlanta, Boston, Denver, We find that public charter schools outperform 
Houston, Indianapolis, New York City, San Antonio, TPS in each of the eight cities on both 

and Washington, D.C. productivity measures. On average across the 
cities, public charter schools are 31 to 32 percent 


We use two measures - cost-effectiveness and 


return-on-investment (ROI) - to determine which ineleul = etake ini Seu et altel ouneyelt Fetch) 275. /SeUeh=th 


eilahecelqosl Coa me erecucne dabicecs: larger ROI than TPS. The charter cost-effectiveness 


bang for the taxpayers’ bucks for those eight cities advantage ranges from 2 percent in Houston to 


68 percent in Washington, D.C., while the charter 


We find that public charter schools outperform TPS in each of the 
eight cities on both productivity measures. 
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ROI advantage ranges from 4 percent in Houston 


to 85 percent in the nation’s capital. 


Background: Spending 
and Achievement in the 
Eight Cities 


Scholars continue to debate the extent to which 
school resources affect student achievement.'® 
The eight cities in our sample vary substantially 
in both their average per-pupil funding for 
public school students in both the public 
charter and TPS sectors combined and student 
performance on the NAEP in reading relative 

to the average performance in each city’s state 
(figure 1). Washington, D.C., funds the most 

per public-school pupil, an average of about 
$28,000, and scores slightly above the state 
average on NAEP reading, which is difficult to 
interpret because D.C. is, in effect, its own state."” 


San Antonio, in contrast, funds its public school 


students at a little over $11,000 and its students 
score about equal to the Texas state average in 
reading on the NAEP, a rare achievement for a 
U.S. city. Denver commits slightly more revenue 
per TPS student than San Antonio, but its TPS 
student NAEP scores in reading are more than 50 


percent below the Colorado state average. 


Although the relationship between per-pupil 
funding and student performance relative to 
state averages is statistically zero for these cities, 
places like New York City may commit so much 
revenue to public education precisely because 
they have a student body that is more difficult 

to educate, leading to low student outcomes 
even with a high commitment of resources. 
Obviously, comparing differences in revenue and 
outcomes across cities is not a strong method for 
determining how educational resources actually 
affect student achievement, and we present these 
figures merely to illustrate the soending and 


achievement backgrounds of our cities. 


Figure 1: Relationship between Revenue and Achievement by City in the Sample 
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Note: Revenue data pertain to the 2014 Fiscal Year, which aligns with the 2013-2014 Academic Year, and are adapted from Charter 
School Funding: Inequity in the City, by Wolf et al., 2017, http:/Awww.uaedreform.org/charter-school-funding-inequity-in-the-city/. 


Achievement data are standardized relative to the state overall and cover 2006-07 to 2011-12 and are provided by the Center for 
Research on Education Outcomes (CREDO) Urban Charter School Study: Report on 41 Regions, http://urbancharters.stanford. 


edu/summary.php. 
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As an improvement upon the descriptive data 
illustrated above, we compare NAEP scores to 
per-pupil funding across public school sectors 
within the same city. This way we control for 
cross-city differences in student 


backgrounds in our analyses. 


We present two averages of 
the results across the cities 
in our sample. The first is the 
average of the cities, treating 
each city as a single, equally- 
weighted observation. The second is a student- 
weighted average across the sample, which gives 
greater weight to cities that have more students 
contributing to the calculation and less weight 

to cities that have fewer students contributing. 
The student-weighted calculations of cost- 
effectiveness and ROI are completed in two 

steps. First, we determine the weighted-student 
averages separately by public school sector, with 
cities with relatively larger TPS sectors weighted 
more heavily in the TPS calculation and cities with 
relatively larger public charter sectors weighted 
more heavily in the charter calculation. After the 
student-weighted average results are determined 
for each sector, the lower number (always the 

TPS number in our case) is subtracted from the 
higher number (always the public charter number 
in our case) to determine the weighted average 

of the charter productivity advantage (see the 
Methodology Appendix for details). This two- 

step process generates true student-weighted 
average productivity levels across our sample at 


both the sector and overall levels. If, instead, one 


weights each city’s results by the combined K-12 
student population for both TPS and charter, the 
productivity results change somewhat but not 


dramatically. 


AS an improvement upon the descriptive 
data illustrated above, we compare NAEP 
scores to per-pupil funding across public 

school sectors within the same city. 


Our analysis addresses the question of levels 

of student disadvantage in the charter and 

TPS sectors in two ways. First, the evidence on 
student achievement differences between the 
two public school sectors in a given city used 

in the ROI analysis come from a Stanford study 
in which students in the public charter and 

TPS sectors were matched on factors such as 
previous test scores and low-income, English 
language learner, and special education status."® 
Second, the evidence on revenue differences 
between charter and TPS in our cities come 
from our previous revenue study in which we 
found that three of our cities - Denver, Houston, 
and New York - enrolled higher or similar rates 
of low-income students in their charter sectors 
compared to their TPS sectors in 2014.'° The other 
five cities - Atlanta, Boston, Indianapolis, San 
Antonio, and Washington - enrolled a higher rate 
of low-income students in their TPS than their 
charter sectors but the differences were only 
large in the case of Indianapolis. The TPS sectors 


more consistently enrolled higher percentages of 


Thus, different levels of student disadvantage across the public 
school sectors in our cities explain some but not all of the 
productivity advantage for public charter schools. 
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students labeled as English learners or in special 
education, but those enrollment gaps failed to 
explain much of the revenue differences between 
the public school sectors in Denver, Indianapolis, 
New York City, San Antonio, or Washington. Thus, 
different levels of student disadvantage across 
the public school sectors in our cities explain 
some but not all of the productivity advantage for 


public charter schools. 


Cost-Effectiveness Using NAEP 
Achievement Scores 


Cost-effectiveness is “the efficacy of a program 

in achieving given intervention outcomes in 
relation to the program costs.” 2° Our study 
measures the effectiveness of the school 

system to attain outcomes relative to the costs 
associated with improving children’s academic 
achievement throughout their 13-year K-12 
educational experience. We use the nation’s 
report card - NAEP math and reading scores - as 
the intervention outcome and the total per- 
pupil revenue allocated in fiscal year (FY) 2014 to 
students in the public charter and TPS sectors as 


the program cost. 


Students in 4°, 8%, and 12% grade take the NAEP 
exam. The 4" grade NAEP results likely understate 
all of the learning acquired throughout the K-12 
educational experience, as students still have over 
60 percent of their schooling remaining. The 12" 
grade NAEP results likely overstate overall learning 
levels because they do not include struggling 
students who dropped out prior to 12" grade. As 
a result, we use 8" grade NAEP math and reading 
test scores for our outcome in this analysis. The 
results are similar if 4° grade NAEP scores are 


used in place of 8" grade scores, and 12'" grade 


ill 


NAEP scores are not available at the individual 
city level. Although it would be interesting to 
compare the cost-effectiveness of the public 
charter and TPS sectors specifically for low- 
income students, such subgroup NAEP data are 


not available at the city level. 


Math and reading scores are not the only 
outcomes produced by educational institutions. 
However, public schools explicitly focus on 
standardized tests, especially since math 

and reading test scores were public school 
accountability measures mandated by the federal 


government 


Math and reading 
test scores at the 
very least serve as a 
proxy measure for 
the overall quality 
of an educational 
experience. 


during the period 
of this study. 
Further, math 
and reading 

test scores at 

the very least 
serve as a proxy 
measure for the 
overall quality of 
an educational 


experience. Our first measure is calculated as: 


: Achievement Scores 
Cost-Effectiveness = 


Per-Pupil Revenue 


See the sidebar for an example computation of 
cost-effectiveness for Atlanta. After considering 
the per-pupil funding differences across the two 
sectors, Atlanta public charter schools produced 
an average of 2.16 more points on the NAEP 
reading assessment and 2.26 more points on 

the NAEP math exam for each $1,000 in funding 
than Atlanta TPS. This difference illustrates a 14 
percent public charter school advantage over TPS 
in cost-effectiveness in producing reading and 


math scores. 
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We 


Atlanta public charter schools produced an average of 2.16 more 
points on the NAEP reading assessment and 2.26 more points on 
the NAEP math exam for each $1,000 in funding than Atlanta TPS. 


Overall Cost-Effectiveness Results 


Now we consider the results 
across all eight of our cities. 
The average public charter 
school sector in our sample 
produced 17.76 NAEP reading 
points per $1,000 funded 
compared to 13.42 points in 
the average TPS sector (table 
1). This 4.34 NAEP reading score 
difference represents a 32 
percent public charter school 
sector advantage over TPS in 
cost-effectiveness. Accounting 
for the different sizes of the 
K-12 populations in the public 
charter and TPS sectors of 
the eight cities, the student- 
weighted average production 
of the public charter sector 
was 15.28 NAEP reading 
points per $1,000 compared 
to 11.29 for TPS. The student- 
weighted public charter 
school advantage of 3.99 
points per $1,000 represents 
a cost-effectiveness benefit of 


35 percent. 


Example Computation: Atlanta 


Our cost-effectiveness metric is a benefit-cost ratio of NAEP math 
and reading achievement to average per-pupil revenues allocated 


for each sector. This calculation can be expressed as: 


nd Se NAEP Achievement Points 


Per-Pupil Revenue 


In Atlanta traditional public schools, average NAEP scores were 257 
for reading and 272 for math, and per-pupil revenue was $16,429. 
In Atlanta public charter schools, average NAEP scores were 258 
points for reading and 273 for math, and per-pupil revenue was 
$14,490. Notably, even if funding levels were equal across the two 
public school sectors, public charter schools in Atlanta would be 
more cost-effective than TPS in 2014, as they produced higher 


math and reading test scores. 


The cost-effectiveness calculations for Atlanta are the following: 


oe 15.66. racy 


Nae 257.19 = 15.66. 
$16,429 $1,000 ~.  peadinc 
_-- 2.16 
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This 434 NAEP reading score difference represents a 32 percent 
oublic charter school sector advantage over TPS in cost-effectiveness. 


Table 1: NAEP Reading Achievement Levels per Thousand Dollars Funded 


Traditional Public Schools Public Charter Schools Difference 
Per Pupil NAEP Points NAEP Per Pupil NAEP Points | NAEP Points 
Location re Bee |ebes $1,000 ceais Berths per $1,000 per $1,000 
Funded Funded Funded 

Indianapolis $14,388 $8,810 
San Antonio 260.34 $12,097 261.46 $9,629 
Denver 247.95 $14,027 249.21 $11,083 
Washington, D.C. $35,261 $21,387 


CITY AVERAGE 


STUDENT-WEIGHTED 
AVERAGE 


254.55 $18,963 


253.84 $22,480 


Boston 253.95 $22,389 262.21 $18,475 
New York City 253.10 $26,289 254.25 $21,281 
Atlanta 257.19 $16,429 258.28 $14,490 
Houston 257.40 $10,829 258.03 $10,604 


257.00 


255.48 


$14,470 


$16,718 


Note: Revenue data pertain to the 2014 Fiscal Year, which aligns with the 2013-2014 Academic Year, and are adapted from 
Charter School Funding: Inequity in the City, by Wolf et al., 2017, http:/www.uaedreform.org/charter-school-funding-inequity- 
in-the-city/, NAEP achievement data are from 2015 and are adapted from http://nces.ed.gov/nationsreportcard/naepdata/ 


dataset.aspx. 


These cost-effectiveness results differ across 


the eight cities. The charter school cost- 


effectiveness advantage ranges from 2 percent 


in Houston to 67 percent in the nation’s capital 


(figure 2). Seven of the eight cities have public 


charter school cost-effectiveness advantages 


exceeding 10 percent and six of these are above 


20 percent. 


The student-weighted public 


charter school advantage 
of 3.99 points per $1,000 


reoresents a cost-effectiveness 


benefit of 35 percent. 


The charter school cost-effectiveness advantage ranges from 2 
percent in Houston to 67 percent in the nation’s capital. 
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Figure 2: Reading Cost-Effectiveness Advantage for Public Charter Schools in Percentage Terms, by City 
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The charter school advantage slightly widens the charter school cost-effectiveness advantage 
when we turn our attention to NAEP math scores. exceeded 64 percent in both locations. Boston, 
On average, per $1,000 funded, the public charter New York City, and San Antonio all had charter 
school sectors in our study produce 19.21 NAEP schools producing around 25 percent higher 
math points compared to 14.48 points forthe TPS math test scores for each $1,000 funded. 
sectors (table 2). This 4.73 point math difference 

is equivalent to a 33 percent cost-effectiveness 


advantage for public charter schools. The 


student-weighted average production This 4°75 point math cinrerence iS 
of the public charter sector was 16.59 ; 

equivalent to a 4543 percent cost- 
NAEP math points per $1,000 compared 
to 12.22 for TPS. The student-weighted effectiveness adva ntage for PU bl Ic 
public charter school advantage of 4.37 charter schools. 
points per $1,000 represents a cost- 
effectiveness benefit of 36 percent. 
The public charter school advantage The DU blic charter school adva ntage 
Dn ce scl a Gooiae InniMatinieCGst-elmeetvenicss is 70 


percent or larger in all but two 


percent or larger in all but two 
locations - Atlanta and Houston. 


locations - Atlanta and Houston 
(figure 3). Again, the gaps were the 


largest in D.C. and Indianapolis, where 
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Table 2: NAEP Math Achievement Levels per Thousand Dollars Funded 


Traditional Public Schools Public Charter Schools Difference 
NAEP Points NAEP Points | NAEP Points 


NAEP Per Pupil NAEP Per Pupil 


Focation Score Revenue oe ee Score Revenue ga No ee ee 
Indianapolis 277.90 $14,388 280.21 $8,810 
San Antonio 281.66 $12,097 280.61 $9,629 
Denver 266.78 $14,027 269.47 $11,083 
Washington, D.C. 263.13 $35,261 267.82 $21,387 
Boston ; $18,475 


New York City 
Atlanta 272.34) $16,429 | 
Houston 


$21,281 
272.97 $14,490 
282.92 $10,604 


277.92 $14,470 


ZT 27. 


AVERAGE 274.61 $18,963 


STUDENT-WEIGHTED 
AVERAGE 


274.62 $22,480 16,718 


Note: Revenue data pertain to the 2014 Fiscal Year, which aligns with the 2013-2014 Academic Year, and are adapted from Charter 
School Funding: Inequity in the City, by Wolf et al., 2017, http:/Awww.uaedreform.org/charter-school-funding-inequity-in-the-city/. 
NAEP achievement data are from 2015 and are adapted from http://nces.ed.gov/nationsreportcard/naepdata/dataset.aspx. 


Figure 3: Math Cost-Effectiveness Advantage for Public Charter Schools, by City 
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Calculating ROI in Terms of The income return to investment is the net 


Economic Returns to Education present value of additional lifetime earnings 


accrued through higher cognitive ability as 


Rede elatiasce dane) ake CUie: measured by test scores. Average learning 


A performance measure used gains for the charter and TPS sectors in each 

to evaluate the efficiency of an of the eight cities come from the CREDO 
investment or to compare the Urban Charter Schoo! Study. CREDO researchers 
efficiency of a number of different carefully matched students in the public charter 
investments. ROI measures the sector with “virtual twins” in the TPS sector on 
amount of return on an investment previous test scores and low-income, English 
relative to the investment’s cost. To language learner, and special education status.” 
calculate ROI, the benefit (or return) Stanford University economist Eric Hanushek has 
of an investment is divided by the cost estimated that a one standard deviation increase 
of the investment, and the result is in cognitive ability leads to a13 percent increase 
expressed as a percentage or a ratio." in lifetime earnings.” Only 70 percent of gains in 


; . learning persist each year. If we multiply these 
In our case, the ROI is the average impact each ; ‘ 
. two estimates together, we find the learning 
sector has on student learning 


gains, and the cost of the 


CREDO researchers carefully matched 
Ber es fees pene err students in the public charter sector with 
of schooling for each sector. “virtual twins” in the TPS sector on previous 
Totneniodiae dns iiss ets, Wie test scores and low-income, English language 
eg ye Lee sore learner, and special education status. 


investment is the total per-pupil 


gains produced by each public 


school sector to the economic 
ae ; ; : ; gains relative to the average worker in the state. 
return of lifetime earnings. This ROI is essentially 
; J By comparing the learning gains relative to the 
a benefit-cost ratio, calculated as: 


average worker in the state, 


we estimate the returns to the 


RO | — Lots ole Ieuan g schooling investment in terms 


Cost of Investment 


of yearly income.* We use 2016 


data from the United States 


The cost of investment is a straightforward Bureau of Labor Statistics to find state-level 
calculation that captures the per-pupil revenue average annual earnings and assume that current 
invested in a child’s K-12 educational experience students will work for 46 years between the ages 
over 13 years. This can easily be calculated by of 25 and 70.® When calculating the net present 
multiplying the average FY 2014 per-pupil value of lifetime earnings, we assume a one 
revenue for each sector by 13. percent yearly growth in average salaries and a 


three percent annual discount rate.” 
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The calculation can be expressed by the following formula (see box below for specifics): 


Lifetime Earnings in State * ie (Sector SD) * (0.13 / SD) * (0.70) lie = Lifetime Earnings in Sector 


LS) a Ae 
= Cost of Investment 3 im: 


Overall ROI Results 
. . Public charter schools in these cities 
Our return on investment calculations for 


each city can be located in a graph with are outperforming their lizs despite 
four quadrants, depending on whether receiving less funding per student. 


student achievement is higher for public t 
schools demonstrate the highest advantage 


charter schools or TPS and whether student a. : 
among the cities in student achievement 


funding is higher for charters or TPS (figure 4). In ; ; ‘ 
gains compared to their TPS, an increase of 24 


practice, the top left quadrant of the graph is all ae . : 
percent of a standard deviation. Indianapolis and 


that matters to us, since all eight cities contain : : 
; : ; Washington, D.C. reveal the largest funding gaps 
public charter school sectors with higher student P on : : 
among the eight cities, as their public charter 


achievement gains and lower funding than their 
schools are funded almost 40 percent below the 


TPS. In other words, public charter schools in f ; 
funding rate for their TPS. 


these cities are outperforming their TPS despite 


receiving less funding per student. Boston charter 
Figure 4: Charter School Funding and Performance 
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@ Charters Have Higher Student Achievement but Lower Funding 


Note: Revenue data pertain to the 2014 Fiscal Year, which aligns with the 2013-2014 Academic Year, and are adapted from Charter 
School Funding: Inequity in the City, by Wolf et al., 2017, http:/Awww.uaedreform.org/charter-school-funding-inequity-in-the-city/, 
Achievement data are standardized relative to the state overall and cover 2006-07 to 2011-12 and are provided by the Center for 
Research on Education Outcomes (CREDO) Urban Charter Schoo! Study: Report on 41 Regions, http://urbancharters.stanford.edu/ 
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The public charter school ROI benefit is even advantage in ROI is $2.09 or 53 percent. The 

larger than the cost-effectiveness advantage charter school ROI advantage exceeds 20 percent 

of charters. On average across the cities, each in six locations, ranging from 4 percent in 

dollar invested in a child’s K-12 schooling results Houston to 85 percent in the nation’s capital. 

in $6.44 in lifetime earnings in public charter Notably, public charter schoo! ROI advantages 
schools compared to $4.67 in lifetime earnings exceed 60 percent in Boston, Indianapolis, and 

in TPS, a higher return of $1.77 per dollar in the Washington, D.C. 

charter versus TPS sectors. As revealed in table 3 

and figure 5, averaged across the eight cities, a A 15-year investment in DU bl ic 
13-year investment in public charters yields ROIs eC hnarierce yields PO inot ore 
that are 38 percent higher than a TPS investment. 38 percent h ig her tha na 


The student-weighted average charter school 


TPS investment. 


Se 
| | Calculating Relative ROI Using the Economic Returns to Education 


Again, the ROI for each city and sector can be calculated as: 


Income Returns to Investment 
ROS a ee 


Cost of Investment 


Peacdad (TPS) _ | TPs 
$ Per-Pupil Revenue - Cost of Investment 


= (Charter e — | Charter 
Per-Pupil Revenue Cost of Investment 


Charter 6 PS 6.5 Half Charter Schooling 


; 5 . 5 
Per-Pupil * Years |b | Per-Pupil * years Cost of Investment 
Revenue Revenue 


Average lifetime changes in lifetime Income Return to Investment 
earnings for workers earnings accrued from for TPS Students 
in a given state learning gains in TPS 


Average lifetime changes in lifetime income Return to Investment 
earnings for workers earnings accrued from for Charter Students 
in a given state learning gains in Charters 


Example Computation: Atlanta 


We again turn to Atlanta for an example of how we computed the charter school ROI compared 
to the TPS ROI. The per pupil-revenue is $16,429 in TPS and $14,490 for public charter schools, so 
a 13 year investment would equal $213,577 in TPS and $188,369 in charters. The average lifetime 
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earnings for a worker in the state of Georgia is $1,158,067.2” Since the expected Atlanta TPS 
achievement effects are 14.5 percent of a standard deviation less than the Georgia state average, 
and 70 percent of learning impacts disappear from one year to the next, the expected lifetime 
earnings for a student spending 13 years in a TPS in Atlanta is $974,409. Dividing this benefit 

by the cost of investment yields an ROI of $4.56 for each dollar invested in TPS in Atlanta. Since 
the expected Atlanta public charter school achievement effects are 11.4 percent of a standard 
deviation lower than the Georgia state average, the expected lifetime earnings for a student 
attending a public charter school for 13 years in Atlanta is $1,011,249. Dividing this benefit by the 
cost of investment yields an ROI of $5.37 for each dollar invested in public charters in Atlanta. The 
charter school ROI of $5.37 compared to the TPS ROI of $4.56 yields an 18 percent ROI advantage 
favoring public charter schools in Atlanta. 


Further, if a student in Atlanta experiences half of their K-12 education (6.5 years) in TPS and the 
other half in public charters, the taxpayer ROI is $4.94, still around 8 percent higher than the RO! 
for a full 13-year K-12 educational investment in TPS. 


ROI = Income Returns to Investment / Cost of Investment 


Cost of Investment = Per-Pupil Revenue (TPS) * 13 years 


In TPS Full Time: $16,429 * 13 years = $213,572 
Lifetime earnings amount: ROI for TPS: 
$1,158,067 * [1 - (0.145 SD) * (0.13/SD) * (0.70))]"* = $974,409 $974,409 / $213,572 = $4.56 
In Charter Full Time: $14,490 * 13 years = $188,369 
Lifetime earnings amount: ROI for Charter: 


$1,158,067 * [1 - (0.114 SD) * (0.13/SD) * (0.70))]* = $1,011,249 
$1,011,249 / $188,369 = $5.37 


In Charter Half Time: ($14,490 * 6.5 years) + ($16,429 * 6.5 years) = $200,970 


Lifetime earnings amount: ROI for Half in Each: 


$1,158,067 * [1 - (0.145 SD) * (0.13/SD) * (0.70))]®5 + 
$1.158,067 * [1 - (0.114 SD) * (0.13/SD) * (0.70))]*° = $992,658 | 292,658 / $200,970 = $4.94 


Moreover, an investment in students spending half of their time in each sector yields an overall ROI 
benefit of $5.40 for each invested dollar, a 16 percent advantage relative to a full-time (13 year) K-12 
experience in TPS or 29 percent if student-weighted.” As shown in the last column of table 3, and 

figure 6, these benefits in higher ROI from charter schooling range from 2 percent in Houston to 32 


percent in Washington, D.C. 
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Table 3: ROI Comparisons between Charter and Traditional Public Schools in the Cities 


Charter 13 Years Charter 6.5 Years 
eeation ROI Difference ROI Difference ROI Difference ROI Difference 
(Charter - TPS) (Percent) (Charter - TPS) (Percent) 
Washington, D.C. $3.83 $1.44 
Indianapolis $3.27 $1.24 
Boston $1.59 $0.68 
Denver $1.16 $0.51 
San Antonio $2.28 $1.01 
New York City $0.87 $0.39 
Atlanta $0.81 $0.38 
Houston $0.33 $0.16 


CITY AVERAGE 


STUDENT-WEIGHTED 
AVERAGE 


Figure 5: ROI for Charter Schools Relative to TPS (13 Years in Charter) 
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Figure 6: ROI for Charter Schools Relative to TPS (6.5 Years in Charter) 
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Conclusion and Policy Implications 


This report further supports the existing evidence 
that public charter schools result in a bigger bang 
for fewer bucks than traditional public schools. 
Our evidence indicates that charter schools, 

on average, yield a more efficient allocation of 
educational resources than does the traditional 
way of delivering public education through 
geographically defined school districts. Since 
educational resources are limited, charter 
schools look to be an especially attractive vehicle 
for delivering education to students more 


productively. 


Our study has limitations. It is merely descriptive, 
presenting the relationships between school 


revenue and student outcomes as they were 


observed. However, the cost-effectiveness and 

ROI analyses are rigorous, as they both use 
CREDO results based on a quasi-experimental 
methodology that eliminates many observable 
differences in student background characteristics 
across the public charter and TPS sectors. In 
addition, our productivity results are similar - both 
indicating large public charter school advantages 


- whether estimating cost-effectiveness or ROI. 


The situation in Houston requires some 
explanation. Houston public charter schools had 
the smallest advantage in productivity relative to 
their TPS among the eight charter sectors in our 
study. That does not mean, however, that Houston 


charters are laggards in either performance or 
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productivity. The public charter school sector 

in Houston was third highest among the urban 
charter sectors in cost-effectiveness for both 
reading and math, exceeded only by the charter 
sectors in Indianapolis and San Antonio. The 
traditional public school sector in Houston, 
however, was the most productive TPS in our 
study. Thus, the small size of the productivity 
advantage of Houston charters relative to 
Houston TPS is largely due to both public school 
sectors in Houston being highly and almost 


equally productive. 


Our findings only pertain to the eight cities 


included in our analyses. Those cities, however, 


22 


represent the diversity of American urban 
areas with public charter school sectors. Our 
sample includes both the largest city in the 
U.S., New York, and a relatively small one, 
Atlanta. It includes cities in the north (Boston 
& Indianapolis), south (Atlanta, Houston & San 
Antonio), east (Boston & Washington, D.C.), 
and west (Denver). The public charter school 
sectors in all eight of these U.S. cities are more 
cost-effective and deliver a higher return-on- 
investment than their respective traditional 
public school sectors. In these important urban 
environments, there is a clear productivity 


advantage for public charter schools. 
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Appendix A 


Methodology for Revenue Data that Informed the Study 


Location Selection 


The team selected 15 metropolitan areas for the 
revenue analysis that contributed to this return 
on investment (ROI) study,?? based on one of 
two criteria: the concentration of charter schools 
within an area or the potential for charter school 
growth there. Locations represent selected 

cities or counties used as an analysis domain 

for aggregating district data and geographically 
and demographically similar charter school data 
for comparative purposes. The objective of our 
location selection is to match district students 
with charter students by educational setting and 
student need. Locations are used as a proxy for 
urban/metropolitan settings. They can include a 
single district or multiple districts, and include 
geographically related multiple charter schools. 
The revenue study provided district and charter 
revenue totals and funding disparity amounts 


Table A1: Cities Included in and Excluded from the Productivity Analyses 


for each location. As shown in the table below, 
our productivity analysis was limited to eight 
locations because NAEP scores were not available 
for six locations and one location was an outlier. 


Fiscal Year 


We gathered publicly available revenue data for 
the 2013-14 fiscal year (FY14). Because states differ 
in the fiscal year used for their public schools, 

we attempted to select the fiscal year that most 
closely matched the 2013-14 school year. We refer 
to that year throughout this report as “FY 2014.” 


Data Gathering 


Source records were acquired directly from official 
state department of education records, and from 
independently audited financial statements 
when a state does not collect financial data. For 
New York City, we used detailed expenditure 

data from the New York City 
Education Department due 


Included in NAEP 


city ROI Analysis 


Reason for Exclusion from Analysis 


to the greater level of detail 
available. We used the most 


Houston Yes 


reliable, most detailed, official 


Atlanta Yes 
Boston 


records available in all cases. 
The same data and analysis 


New York City 


standards for three previous 


San Antonio 


revenue studies were applied 


Denver 


for each location in the 


Indianapolis 


study.° 


Washington, D.C. 


Revenues and expenditures 


were collected from many 


sources, from state and 


federal agencies where these 


data are kept, as well as 


from audits. After the FY14 
school year concluded, the 


Tulsa NAEP Achievement Data Not Available 
Little Rock NAEP Achievement Data Not Available 
Shelby NAEP Achievement Data Not Available 
Los Angeles NAEP Achievement Data Not Available 
Oakland NAEP Achievement Data Not Available 
Camden NAEP Achievement Data Not Available 
New Orleans Outlier 
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team waited 18 months to begin researching 
this project to allow state departments of 
education and charter schools time to produce 
and submit all of their official financial records, 
Annual Financial Reports, independent audits, 
enrollment statistics, and other data. The 
methodology matches a state’s Department 

of Education’s (DOE) records of school district 
revenues to the same fiscal year of data drawn 
from independent audits for the charter schools. 
Because all data analyzed for districts and 
charter schools are as of the same date, FY14, all 
data are properly matched based on reporting 
time period. 


The analytic team did not rely upon finance 
data or demographic data collected by Federal 
agencies, except in very rare cases where the data 
are not available from state and local sources. 
Data sourced from Federal agencies have gone 
through extensive aggregation and reporting 
processes that tend to be aggregated to the 
point where there is insufficient specificity to be 
useful for our analysis, and where we have seen 
reporting errors when checked against original 
state sources. 


New Orleans is excluded from our recent set 

of reports, including this productivity analysis. 
State funding and accounting for charter schools 
since Hurricane Katrina has been unusual in the 
Crescent City and not representative of patterns 
or practices in other places. 


Data from Various Unique State Sources, 
Analyzed into Comparative Datasets 


In each state that was home to one of 

the metropolitan areas in our analysis, we 
encountered a maze of web sites, reports, audits, 
and other information that, while extremely 
challenging to piece together, ultimately 
provided the best sources of primary data for 
understanding and analysis of funding levels and 


comparisons. By using each state’s individual 
accounting system, we were able to isolate 
revenue streams for inclusion or exclusion to 
accommodate our consistent methodology and 
to make valid comparisons across school sectors 
and locations. 


We began our research on state web sites, 
searching for financial data reported by local, 
state, federal, and other revenue categories. 
Though many states provided some form of 
revenue data, often the data existed only for 
school districts (not charters), or the data did not 
conform to the classifications used in other states. 
In those cases, we used additional data sources to 
develop conforming revenue figures. In instances 
where the state did not collect charter school 
revenue data, we used independent audits of 
financial data and sometimes federal Form 990. 


We gathered enrollment data from state 
education department web sites. We also 
obtained funding formula guidelines for both 
districts and charters for FY 2013-14. 


Analysis of Revenues, Inclusions and 
Exclusions, Demographic Context 


Productivity calculations, such as these, 

are informed by the revenues received by 
organizations, not their expenditures. Our mission 
was to examine how charter schools were treated 
in state public finance systems, so we focused on 
how much money schools received as a social 
investment. We looked for the following data and 
supporting detail: 


e Revenues: We included all revenues received 
by districts and public charter schools. Our 
goal was to determine the total amount of 
revenue received to run all facets of a school 
system, regardless of source. This analysis 
includes revenues and enrollments related to 
Adult Education and Pre-K. Also included are 
charter school contributions for the purpose 
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of building schools (or other capital items), 
and similarly charter (if any) and district bond 
and loan proceeds for the purpose of building 
schools, excluding proceeds resulting from 
restructuring of debt. For charter schools, we 
included one-time revenues associated with 
starting the school, such as the federal Public 
Charter School Program and, in some cases, 
state and private grants. Fund transfers were 
not considered revenue items, and were not 
included in the analysis. 


Arguably, one-time revenues could have 
been excluded since they are not part ofa 
charter school’s recurring revenues. However, 
they are a notable part of the funding story 
for the charter sector; when considering 

how much money is provided to run charter 
schools, these revenues cannot be and were 
not ignored. Furthermore, we also included 
onetime grants of various kinds to districts. 


Funds initially received by traditional public 
schools that were passed along to charters 
usually were flagged as pass-through funds 
in the documentation we used to determine 
charter school revenue. In some cases we 
were able to identify additional cases of 

TPS providing services to charter students, 
usually involving special education, through 
examining expenditure data. In all cases 
where we were able to determine that 
traditional public school (TPS) funds either 
passed through to charters or were spent on 
charter school students we counted that as 
charter school revenue and not TPS revenue. 
For example, the New York City school district 
made $186 million in in-kind expenditures 
supporting the charter schools in the city in 
FY14. We reduced the district’s revenue by 
$186 million and increased the charter sector 
total by the same amount, as that revenue 
supported charter students. For further detail 
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on how we handled in-kind support for 
charter schools, and the fascinating case of 
charter school funding in the Big Apple, see 
our recent case study of New York City." 


e Enrollment: Where multiple forms of 
enrollment data were available, we used the 
figures related to the official fall count day. 
Depending on a state’s particular method of 
reporting enrollment, the official count could 
be either Average Daily Attendance (ADA) or 
Average Daily Membership (ADM). 


e Exclusion of Revenue: The only revenue item 


we excluded from our analysis was funds 
resulting from the restructuring of debt, as 
those are not “new revenues” but merely a re- 
packaging of existing assets and obligations. 


e Selection of Schools: All charter schools in 


each locality were included in this study with 
the exception of schools for which we could 
not obtain valid revenue and enrollment 
data. If we could not obtain revenue data, the 
enrollments for those schools were excluded 
from the analysis. If we could not obtain 
enrollment data, the revenues for that school 
were excluded from the analysis. 


Rounding 


Dollar values were rounded to the nearest dollar 
for each item. Percentages were rounded to 

the nearest whole number, which may cause 
apparent differences by a percentage. 


Tables and Charts 


If no citation accompanies a table or chart, the 
information therein was compiled by the research 
team according to the process outlined above. 
When we relied on the data or publications of 
other organizations, we provided the relevant 
citation. 
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Weighted Average Calculations 


The totals presented in each table are weighted averages based on enrollments in the public school 
sectors of each city. We generated them by taking the total student enrollment in a specific city for 
the 2014 Fiscal Year (2013-14 Academic Year) in their TPS sector and dividing it by the total student 
enrollment in all eight cities in their TPS that year. We did the same for their public charter school 
sectors. To generate the student-weighted average differences we multiply each city’s TPS cost- 
effectiveness or ROI by its percent of the total enrollment for TPS in our collection of cities (table A2), 
take the average of those eight numbers, do the same for the charter sector, and subtract the TPS 
student-weighted average from the charter student-weighted average. This straightforward method 
automatically generates a student-weighted average that is a “true” mean for the aggregated set of 


cities, given their different enrollments across the cities and between the public school sectors. 


Table A2: Percent of Students from Study Locations, FY14 


iocation State Students Percent of Total Students Percent of Total 
(TPS) (TPS) (Charters) (Charter) 
Atlanta GA 44,896 3.09% 6,129 3.17% 
Boston MA 54,300 3.74% 9,246 4.78% 
Denver co 73,459 5.06% 13,843 7.16% 
Houston TX 210,716 14.53% 31,025 16.04% 
Indianapolis IN 30,813 2.12% 21,392 11.06% 
New York City NY 936,009 64.52% 69,093 35.72% 
San Antonio TX 53,811 3.71% 6,833 3.53% 
Washington, D.C. DC 46,643 3.22% 35,847 18.53% 
TOTALS 1,450,647 100.00% 193,408 100.00% 
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Appendix B 
Revenue Information Sources 


Colorado (Denver) 


© Colorado Department of Education, the School Finance Unit 


District of Columbia 
© District of Columbia Public Charter School Board 


© District of Columbia Department of Revenue 


Georgia (Atlanta) 


© Georgia Department of Education, Office of Finance and Business Operations and Charter 
Schools Office 


© Georgia Charter Schools Association 
@ Fulton County Schools Finance and Business 


© Atlanta Public Schools Financial Services and Charter Schools Office 


Indiana (Indianapolis) 


V Indiana Department of Education, School Finance 


Massachusetts (Boston) 
© Massachusetts Department of Elementary and Secondary Education, School Finance 


© Massachusetts Department of Elementary and Secondary Education, Charter Schools Office 


NCES 


© Massachusetts Department of Revenue, Division of Local Services 


New York (New York City) 
D New York State Education Department 


© Audited Annual Financial Reports from school districts 


Texas (Houston, San Antonio) 


© Texas Education Agency, Division of School Finance, Information Analysis Division, and 
Division of Charter Schools 


J Texas Resource Center for Charter Schools 
© Houston Independent School District 


© Dallas Independent School District 


BIGGER BANG, FEWER BUCKS? THE PRODUCTIVITY OF PUBLIC CHARTER SCHOOLS IN EIGHT U.S. CITIES 


2h 


Research Team 


Corey A. DeAngelis 


Mr. DeAngelis is a Distinguished Doctoral Fellow and Ph.D. candidate in Education 
Policy at the University of Arkansas in Fayetteville and a Policy Analyst at the Cato 
Institute’s Center for Educational Freedom. His research focuses on the effects of school 
choice programs on student achievement and non-academic outcomes. He holds 

a Bachelor of Business Administration and a Master of Arts in Economics from the 
University of Texas at San Antonio. 


Patrick J. Wolf, Ph.D. 


Dr. Wolf is a Distinguished Professor of Education Policy and 21st Century Endowed 
Chair in School Choice at the University of Arkansas in Fayetteville. He has authored, 
co-authored, or co-edited four books and over 130 journal articles, book chapters, and 
policy reports on school choice, civic values, public management, special education, 
and campaign finance. He received his Ph.D. in Political Science from Harvard 
University in 1995. 


Larry D. Maloney 


Mr. Maloney is president of Aspire Consulting and has investigated expenditure 
patterns of the nation’s public schools on behalf of states and individual school 
districts since 1992. Mr. Maloney participated in the research team for the Fordham 
Institute revenue study in 2005, the Ball State University revenue study in 2010, and the 
University of Arkansas study in 2014. Recent projects include evaluations of revenues 
and expenditure patterns of eleven major metropolitan school districts and the charter 
schools located within their boundaries. Mr. Maloney co-authored a series of reports 
for the Fordham Institute on future retirement costs for three school districts, as well 
as conducted a school-by-school expenditure analysis for the Washington, D.C. region. 
He served as the evaluator for a U.S. Department of Education program designed to 
enhance the level of products and services provided by state charter associations. 
Additionally, he provided the financial analysis for the U.S. Government Accountability 
Office study of Title 1 expenditures and the U.S. Department of Education National 
Charter School Finance Study. 


Jay F. May 


Mr. May is founder of, and senior consultant for, EduAnalytics, LLC, a consulting practice 
focused on hands-on data-based initiatives to improve student performance. Mr. 

May’s client work includes developing technology infrastructure for various aspects 

of student performance management - student information systems, instructional 
data management systems, assessment results delivery and analysis frameworks. Mr. 
May, a CPA, has expertise in K-12 education finances and provides research, consulting, 
and analysis for various aspects of funding equity and allocation. He is a co-inventor 

of In$ite® - the Finance Analysis Model for Education® - a patented software tool for 
school-level and district-level expenditure analysis. 


BIGGER BANG, FEWER BUCKS? THE PRODUCTIVITY OF PUBLIC CHARTER SCHOOLS IN EIGHT U.S. CITIES 


Endnotes 


aon oa -_ W 


National Center for Education Statistics, Table 236.10. 


Andrews, L. (2018, January 26), The pension crisis is starting to hit home: School choice might be the only answer, 


National Review. Aldeman, C. (2018, January 12), Thanks to rising benefit costs, San Diego needs your help cutting its 


school budget, Teacher Pensions Blog. 


National Center for Education Statistics, Public Charter School Enrollment. 


Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2003), Evaluation: A systematic approach, Sage publications. 


Return On Investment - ROI. 


Emma, C., Suro, R., Columbus, E., Akers, M. A., & Greenfield, J. (2016, September 08). Trump unveils $20B school 
choice proposal, Politico. 


Layton, L. (2013, June 25). Charters not outperforming nation’s traditional public schools, report says, Washington Post. 


Foreman, L., Anderson, K.P., Ritter, G., Wolf, PJ. (2017), Using “broken lotteries” to check the validity of charter school 
evaluations using matching designs, Educational Policy. Mills, J.N. (2013). The achievement impacts of Arkansas open- 


enrollment charter schools. Journal of Education Finance, 38(4), 320-342. 


Cheng, A., Hitt, C., Kisida, B., & Mills, J. N. (2017, March), “No excuses” charter schools: A meta-analysis of the 
experimental evidence on student achievement, Journal of School Choice 11(2), 209-238. Betts, J. R., & Tang, Y. E. 


(2014), A meta-analysis of the literature on the effect of charter schools on student achievement. Working Paper. Bothell, 
WA: Center for Reinventing Public Education. Cremata, E., Davis, D., Dickey, K., Lawyer, K., Negassi, Y., Raymond, M.E., 
et al. (2013), National charter school study 2013, Center for Research on Education Outcomes, Stanford, CA: Stanford 
University. Zimmer, R., Gill, B., Booker, K., Lavertu, S., Sass, T. R., & Witte, J. (2009), Charter schools in eight states: Effects 
on achievement, attainment, integration, and competition. Santa Monica, CA: RAND Corporation. 


10 CREDO (2015), Urban Charter School Study: Report on 41 Regions, Palo Alto: Stanford University. 


11 


Batdorff, M., Finn, C.E., Hassel, B., Maloney, L., Osberg, E., Speakman, S., Terrell, M.G. (2005), Charter school funding: 
Inequity’s next frontier, Washington, DC: Thomas B. Fordham Institute. Batdorff, M., Maloney, L., May, J., Doyle, D., 

& Hassel, B. (2010), Charter school funding: Inequity persists, Ball State University. Batdorff, M., Maloney, L., May, 

J. F., Speakman, S. T., Wolf, P. J., & Cheng, A. (2014), Charter school funding: Inequity expands, School Choice 
Demonstration Project, University of Arkansas. 


12  Batdorff, M., Cheng, A., Maloney, L., May, J.F., & Wolf, P.J.(2015, June), Buckets of water into the ocean: Non-public 


revenue in public charter and traditional public schools, School Choice Demonstration Project, University of Arkansas. 


13 Wolf, P. J., Cheng, A., Batdorff, M., Maloney, L., May, J., & Speakman, S. (2014), The productivity of public charter 


schools, School Choice Demonstration Project, University of Arkansas. 


14 Wolf, P. J., Maloney, L. D., May, J. F., & DeAngelis, C. A. (2017), Charter school funding: Inequity in the city, School 


Choice Demonstration Project, University of Arkansas. 


15 Weuse NAEP scores from the following year since it is the closest year of data available to the 2014 revenue data. In 


addition, one might expect that an investment in 2014 would translate to student outcomes in the next year. 


16 Johnson, R.C., & Jackson, K. (2017), Reducing inequality through dynamic complementarity: Evidence from Head 


Start and public school spending. Working Paper w23489. Cambridge, MA: National Bureau of Economic Research. 
Hanushek, E. A. (1996), School resources and student performance, in G. Burtless (ed.), Does Money Matter? The Effect 
of School Resources on Student Achievement and Adult Success, Washington, DC: Brookings. 


17. The state education agency for D.C. pays for some Washington students to be educated outside of the District, which is 


why the performance level within D.C. is not exactly equal to the “statewide” average. 


18 CREDO (2015), Urban Charter School Study: Report on 41 Regions, Palo Alto: Stanford University. 


BIGGER BANG, FEWER BUCKS? THE PRODUCTIVITY OF PUBLIC CHARTER SCHOOLS IN EIGHT U.S. CITIES 


Zo) 


19 


20 
21 
22. 
23 
24 


78) 
26 


2, 
28 


29 


30 


31 


Wolf, P. J., Maloney, L. D., May, J. F., & DeAngelis, C. A. (2017), Charter School Funding: Inequity in the City, School 
Choice Demonstration Project, University of Arkansas. 


Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2003), Evaluation: A systematic approach, Sage publications. 


Return On Investment - ROI. 


CREDO (2015), Urban Charter School Study: Report on 41 Regions, Palo Alto: Stanford University. 


Hanushek, E. A. (2011), The economic value of higher teacher quality, Economics of Education Review, 30(3), 466-479. 


We use learning gains for each city and sector, relative to the state, produced by CREDO (2015), Urban Charter School 


Study: Report on 41 Regions, Palo Alto: Stanford University. 


United States Bureau of Labor Statistics, Occupational Employment Statistics, May 2016. 


Hanushek, E. A. (2011), The economic value of higher teacher quality, Economics of Education Review, 30(3), 466- 
479. See also Wolf, P. J., Cheng, A., Batdorff, M., Maloney, L., May, J., & Speakman, S. (2014), The productivity of public 
charter schools, School Choice Demonstration Project, University of Arkansas. 


Calculated from data in United States Bureau of Labor Statistics, Occupational Employment Statistics, May 2016. 


The numerator for the calculation of ROI for students who spend 6.5 years in charters, measuring the benefits 

they receive from doing so, is exactly half of the numerator for students who spend all 13 years in charters. The 
denominator, however, is larger for students who spend 6.5 years in charters compared to those who spend 13 years in 
charters because spending on them is higher during the 6.5 years they are in TPS. Asa result, the ROI for spending 6.5 
years in a public charter school is less than half the ROI for spending 13 years in a charter. 


Wolf, P.J., Maloney, L.D., May, J.F., & DeAngelis, C.A. (2017, May), Charter school funding: Inequity in the city, School 
Choice Demonstration Project, University of Arkansas, Fayetteville, AR. 


Batdorff, M., Maloney, L., May, J., Speakman, S., Wolf, P.J., & Cheng, A. (2014), Charter school funding: Inequity 
expands, School Choice Demonstration Project, University of Arkansas, Fayetteville, AR. Batdorff, M., Maloney, L., May, 
J., Doyle, D., & Hassel, B. (2010), Charter school funding: Inequity persists, Muncie, IN: Ball State University. Batdorff, M., 
Finn, C.E., Hassel, B., Maloney, L., Osberg, E., Soeakman, S., Terrell, M.G. (2005), Charter school funding: Inequity’s next 
frontier, Washington, DC: Thomas B. Fordham Institute. 


Maloney, L.D., & Wolf, P.J. (2017, August), Charter school funding: Inequity in New York City, School Choice 
Demonstration Project, University of Arkansas, Fayetteville, AR. 


